Compatibility with DynamicPPL 0.38 + InitContext #2676

penelopeysm · 2025-09-24T18:05:52Z

It should be noted that due to the changes in DynamicPPL's src/sampler.jl, the results of running MCMC sampling on this branch will pretty much always differ from that on the main branch. Thus there is no (easy) way to test full reproducibility of MCMC results (we have to rely instead on statistics for converged chains).

TODO:

pMCMC (it at least runs and gives sensible results on simple models, proper tests will have to wait for CI to run)
Gibbs (same as above)
fix initial_params argument for most samplers to require AbstractInitStrategy
fix tests
changelog

Separate PRs:

use InitStrategy for optimisation as well

Note that the three pre-existing InitStrategies can be used directly with optimisation. However, to handle constraints properly, it seems necessary to introduce a new subtype of AbstractInitStrategy. I think this should be a separate PR because it's a fair bit of work.
fix docs for that argument, wherever it is (there's probably some in AbstractMCMC but it should probably be documented on the main site) EDIT: https://turinglang.org/docs/usage/sampling-options/#specifying-initial-parameters

penelopeysm · 2025-09-24T22:32:28Z

src/mcmc/gibbs.jl

-    # Get the initial values for this component sampler.
-    initial_params_local = if initial_params === nothing
-        nothing
-    else
-        DynamicPPL.subset(vi, varnames)[:]
-    end


I was quite pleased with this discovery. Previously the initial params had to be subsetted to be the correct length for the conditioned model. That's not only a faff, but also I get a bit scared whenever there's direct VarInfo manipulation like this.

Now, if you use InitFromParams with a NamedTuple/Dict that has extra params, the extra params are just ignored. So no need to subset it at all, just pass it through directly!

penelopeysm · 2025-09-24T22:33:47Z

src/mcmc/mh.jl

-# TODO(DPPL0.38/penelopeysm): This function should no longer be needed
-# once InitContext is merged.


unfortunately set_namedtuple! is used elsewhere in this file (though it won't appear in this diff) so we can't delete it (yet)

penelopeysm · 2025-09-24T22:34:53Z

src/mcmc/mh.jl

+function DynamicPPL.tilde_assume!!(
+    context::MHContext, right::Distribution, vn::VarName, vi::AbstractVarInfo
 )
-    # Just defer to `SampleFromPrior`.
-    retval = DynamicPPL.assume(rng, SampleFromPrior(), dist, vn, vi)
-    return retval
+    # Allow MH to sample new variables from the prior if it's not already present in the
+    # VarInfo.
+    dispatch_ctx = if haskey(vi, vn)
+        DynamicPPL.DefaultContext()
+    else
+        DynamicPPL.InitContext(context.rng, DynamicPPL.InitFromPrior())
+    end
+    return DynamicPPL.tilde_assume!!(dispatch_ctx, right, vn, vi)


The behaviour of SampleFromPrior used to be: if the key is present, don't actually sample, and if it was absent, sample. This if/else replicates the old behaviour.

penelopeysm · 2025-09-24T22:39:46Z

src/mcmc/particle_mcmc.jl

-    sampler::S
    varinfo::V
    evaluator::E
+    resample::Bool


For pMCMC, this Boolean field essentially replaces the del flag. Instead of set_all_del and unset_all_del we construct new TracedModel with this set to true and false respectively.

test/mcmc/ess.jl

github-actions · 2025-09-24T23:03:38Z

Turing.jl documentation for PR #2676 is available at:
https://TuringLang.github.io/Turing.jl/previews/PR2676/

codecov · 2025-09-24T23:48:24Z

Codecov Report

❌ Patch coverage is 93.87755% with 12 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (breaking@385f161). Learn more about missing BASE report.

Files with missing lines	Patch %	Lines
src/mcmc/particle_mcmc.jl	86.11%	5 Missing ⚠️
src/mcmc/abstractmcmc.jl	91.42%	3 Missing ⚠️
src/mcmc/ess.jl	66.66%	2 Missing ⚠️
src/mcmc/Inference.jl	50.00%	1 Missing ⚠️
src/mcmc/gibbs.jl	95.00%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##             breaking    #2676   +/-   ##
===========================================
  Coverage            ?   86.45%           
===========================================
  Files               ?       21           
  Lines               ?     1418           
  Branches            ?        0           
===========================================
  Hits                ?     1226           
  Misses              ?      192           
  Partials            ?        0

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

penelopeysm · 2025-09-25T00:59:49Z

test/stdlib/distributions.jl

+                            seed = if dist isa GeneralizedExtremeValue
+                                # GEV is prone to giving really wacky results that are quite
+                                # seed-dependent.
+                                StableRNG(469)
+                            else
+                                StableRNG(468)
+                            end
+                            chn = sample(seed, m(), HMC(0.05, 20), n_samples)


Case in point:

julia> using Turing, StableRNGs julia> dist = GeneralizedExtremeValue(0, 1, 0.5); @model m() = x ~ dist m (generic function with 2 methods) julia> mean(dist) 1.5449077018110322 julia> mean(sample(StableRNG(468), m(), HMC(0.05, 20), 10000; progress=false)) Mean parameters mean Symbol Float64 x 3.9024 julia> mean(sample(StableRNG(469), m(), HMC(0.05, 20), 10000; progress=false)) Mean parameters mean Symbol Float64 x 1.5868

penelopeysm · 2025-09-26T20:51:53Z

For the record, 11 failing CI jobs is the expected number:

8x failing jobs because [sources] is not understood on 1.10
3x failing jobs because Libtask 1.12

There is also the failing job caused by base Julia segfault (#2655), but that's on 1.10 so overlaps with the first category.

penelopeysm · 2025-10-14T06:38:26Z

@mhauru, I haven't run CI against the latest revisions like removal of the del flag, but I think this might be meaty enough as it stands and also any adjustments arising from that PR (like renaming islinked) should be quite trivial.

mhauru

Good stuff, some minor comments.

I'm wondering about how to merge this. Should be review the code here, but then hold off merging to breaking before all the 0.38 compat fixes are in and a release of 0.38 is out, so all the temporary source stuff etc. can go and we can see tests pass?

src/mcmc/abstractmcmc.jl

src/mcmc/mh.jl

src/mcmc/particle_mcmc.jl

mhauru · 2025-10-14T14:52:19Z

src/mcmc/repeat_sampler.jl

+    return DynamicPPL.init_strategy(spl.sampler)
+end
+
+function AbstractMCMC.sample(


I don't see why these became necessary now. Is it something about the type hierarchy around Sampler?

Yeah, RepeatSampler is weird, because it doesn't subtype InferenceAlgorithm. So some of the code like default sample methods has to be copied over for it. In the past, the methods used to be written for Union{Sampler{<:InferenceAlgorithm},RepeatSampler}. I think that's worse because it was less flexible, you couldn't change one without affecting the behaviour of the other.

test/mcmc/ess.jl

test/mcmc/is.jl

test/Project.toml

Project.toml

mhauru · 2025-10-14T15:12:37Z

HISTORY.md

+You still need to use the `initial_params` keyword argument to `sample`, but the allowed values are different.
+For almost all samplers in Turing.jl (except `Emcee`) this should now be a `DynamicPPL.AbstractInitStrategy`.
+
+TODO LINK TO DPPL DOCS WHEN THIS IS LIVE


Likewise a reminder comment.

HISTORY.md

penelopeysm · 2025-10-16T14:31:08Z

I'm wondering about how to merge this.

Personally, I'm not too fussed. I think we discussed this last time round and IIRC you said you'd prefer to keep breaking 'clean' and mergeable into main at any given time (apologies if I am misremembering). If that's the case, then we should keep this as the base branch for DPPL 0.38 fixes, until 0.38 is released.

penelopeysm · 2025-10-17T16:17:47Z

Okay, I'm quite happy with where CI on this PR has gotten to. There are a handful of residual failures, which are mostly to do with Sampler methods that I removed a bit too early. #2689 properly handles the removal of Sampler so I don't feel inclined to chase them down here.

mhauru

I think we discussed this last time round and IIRC you said you'd prefer to keep breaking 'clean' and mergeable into main at any given time (apologies if I am misremembering). If that's the case, then we should keep this as the base branch for DPPL 0.38 fixes, until 0.38 is released.

You remember correctly, this would be my preference.

src/mcmc/emcee.jl

HISTORY.md

src/mcmc/mh.jl

Co-authored-by: Markus Hauru <markus@mhauru.org>

mhauru · 2025-10-20T10:13:48Z

A note, mostly for myself: I'm happy with the code in this PR. We should collect other changes related to 0.38 compat into it before merging, since it still leaves things in a broken state. However, once other PRs have been merged into this so that tests pass, and the above reminder comments have been addressed, I'm happy to merge. No need to read through this PR again.

…, `init_strategy`, and other functions from DynamicPPL to Turing (#2689) * Remove `Sampler` and move its interface to Turing * Test fixes (this is admittedly quite tiring) * Fix a couple of Gibbs tests (no doubt there are more) * actually fix the Gibbs ones * actually fix it this time * fix typo * point to breaking * Improve loadstate implementation * Re-add tests that were removed from DynamicPPL * Fix qualifier in src/mcmc/external_sampler.jl Co-authored-by: Xianda Sun <5433119+sunxd3@users.noreply.github.com> * Remove the default argument for initial_params * [skip ci] Remove DynamicPPL sources --------- Co-authored-by: Xianda Sun <5433119+sunxd3@users.noreply.github.com>

penelopeysm marked this pull request as draft September 24, 2025 18:06

penelopeysm force-pushed the py/dppl-0.38 branch from 9658a3e to ed43a02 Compare September 24, 2025 18:12

Import varname_leaves etc from AbstractPPL instead

10f960e

penelopeysm force-pushed the py/dppl-0.38 branch from ed43a02 to bf18516 Compare September 24, 2025 18:12

[no ci] initial updates for InitContext

3a04643

penelopeysm force-pushed the py/dppl-0.38 branch from bf18516 to 3a04643 Compare September 24, 2025 18:16

penelopeysm added 6 commits September 24, 2025 20:58

[no ci] More fixes

7e522a6

[no ci] Fix pMCMC

9bc58c8

[no ci] Fix Gibbs

02d1d0e

[no ci] More fixes, reexport InitFrom

27b0096

Fix a bunch of tests; I'll let CI tell me what's still broken...

7f12c3e

Remove comment

ed197f9

penelopeysm commented Sep 24, 2025

View reviewed changes

Fix more tests

c09c2a5

penelopeysm added 3 commits September 25, 2025 00:57

More test fixes

20f9e97

Fix more tests

ba4da83

fix GeneralizedExtremeValue numerical test

4b143ad

penelopeysm commented Sep 25, 2025

View reviewed changes

penelopeysm added 6 commits September 25, 2025 02:05

fix sample method

b5d82c9

fix ESS reproducibility

c315993

Fix externalsampler test correctly

3afd807

Fix everything (I _think_)

25c6513

Add changelog

d4aaa18

Fix remaining tests (for real this time)

aa3cfcf

penelopeysm mentioned this pull request Sep 25, 2025

Fixes for Turing 0.41 TuringLang/DynamicPPL.jl#1057

Merged

3 tasks

penelopeysm marked this pull request as ready for review September 25, 2025 13:24

Specify default chain type in Turing

c0ea6e0

penelopeysm force-pushed the py/dppl-0.38 branch from 0d42641 to b0badc2 Compare October 3, 2025 09:43

penelopeysm requested a review from mhauru October 14, 2025 06:36

mhauru requested changes Oct 14, 2025

View reviewed changes

penelopeysm mentioned this pull request Oct 16, 2025

Remove Sampler and its interface TuringLang/DynamicPPL.jl#1037

Merged

penelopeysm added 9 commits October 16, 2025 15:45

Fix changelog to mention unwrapped NT / Dict for initial_params

049e950

Remove references to islinked, set_flag, unset_flag

14d3c14

Merge branch 'breaking' into py/dppl-0.38

ae7e1e2

use setleafcontext(::Model, ::AbstractContext)

3a13c63

Fix for upstream removal of default_chain_type

5ed1230

Add clarifying comment for IS test

2a585fc

Revert ESS test (and add some numerical accuracy checks)

16198fa

istrans -> is_transformed

89a61af

Remove loadstate and resume_from

6af6330

penelopeysm force-pushed the py/dppl-0.38 branch from 6aed11b to 6af6330 Compare October 16, 2025 20:46

penelopeysm added 4 commits October 16, 2025 22:58

Remove a Sampler test

85a25b4

Paper over one crack

55e465b

fix resume_from

9c34014

remove a Sampler test

deff3fd

penelopeysm requested a review from mhauru October 17, 2025 16:17

mhauru reviewed Oct 17, 2025

View reviewed changes

src/mcmc/emcee.jl Outdated Show resolved Hide resolved

HISTORY.md Outdated Show resolved Hide resolved

src/mcmc/mh.jl Show resolved Hide resolved

Update HISTORY.md

bbbde35

Co-authored-by: Markus Hauru <markus@mhauru.org>

penelopeysm mentioned this pull request Oct 18, 2025

Gibbs soapbox #2540

Open

mhauru mentioned this pull request Oct 20, 2025

added requested docstrings #2692

Open

penelopeysm and others added 3 commits October 21, 2025 18:36

Fix a word in changelog

0566edb

Improve changelog

43a30a2

		# TODO(DPPL0.38/penelopeysm): This function should no longer be needed
		# once InitContext is merged.

Compatibility with DynamicPPL 0.38 + InitContext #2676

Are you sure you want to change the base?

Compatibility with DynamicPPL 0.38 + InitContext #2676

Conversation

penelopeysm commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

penelopeysm Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

penelopeysm Sep 24, 2025

Choose a reason for hiding this comment

Uh oh!

penelopeysm Sep 24, 2025

Choose a reason for hiding this comment

Uh oh!

penelopeysm Sep 24, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot commented Sep 24, 2025

Uh oh!

codecov bot commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

penelopeysm Sep 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

penelopeysm commented Sep 26, 2025

Uh oh!

penelopeysm commented Oct 14, 2025

Uh oh!

mhauru left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mhauru Oct 14, 2025

Choose a reason for hiding this comment

Uh oh!

penelopeysm Oct 16, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mhauru Oct 14, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

penelopeysm commented Oct 16, 2025

Uh oh!

penelopeysm commented Oct 17, 2025

Uh oh!

mhauru left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mhauru commented Oct 20, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

penelopeysm commented Sep 24, 2025 •

edited

Loading

penelopeysm Sep 24, 2025 •

edited

Loading

codecov bot commented Sep 24, 2025 •

edited

Loading

penelopeysm Sep 25, 2025 •

edited

Loading